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APPARATUS AND METHODS FOR CONVERTING TEXTUAL 
INFORMATION TO AUDIO-BASED OUTPUT 

BACKGROUND OF THE INVENTION 

5 Historically, a computer can provide the ability to convert text passages to an 

audio output for a user. Typically, a user sitting at a computer requests the conversion of 
text to an audio output (e.g. text to speech). Then the computer executes text-to-speech 
(TTS) software that converts the text to the audio output, which the computer then plays 
through a speaker for the user to hear. The user may be an individual who is visually 

10 impaired who uses the TTS software to hear text displayed on the computer screen, a user 
accessing a computer system from an audio communication device (such as a telephone), 
or a user of a computer who prefers to hear speech output rather than reading text on the 
computer's visual display. 
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In one conventional approach to TTS conversion, the user of a client computer or 
telephone may request the conversion of text to speech over a remote or network 
connection to a remote computer (e.g. server) that is executing the TTS softw^are. For 
example, if the user is using a telephone, the user may make a request for a stock report 
5 from the remote computer, which accesses the text for the stock report from a database 
and converts the text to audio-based output. The remote computer then sends the audio- 
based output to the audio telephone to be output through the speaker of the device. In 
another example, if the user is using a client computer, the TTS software on a remote 
computer typically converts the body of text to an audio-based output, such as an output 

10 file having an audio file format. One commonly used audio output file format is the 
WAV audio file format for storing sounds as waveforms, which specifies a ".wav" file 
extension, such as typically used by the Microsoft® Windows® operating system. The 
server then sends the audio file back to the client computer, which plays the audio file for 
the user, who hears the file through the speaker of the client computer. 

15 In another example of a conventional approach, the client computer and server 

computers can be connected through the World Wide Web (WWW), which provides 
communication over a network using the Internet Protocol (IP) and transmits requests 
over the network based on the hypertext transport protocol (HTTP). Users sitting at a 
client computer can thus make HTTP requests to a server located on the web, which 

20 provides information and services to the user at the client computer. Typically, the user 
invokes a web browser at the client computer and makes the request to the web browser, 
which in turn makes the HTTP request over the WWW to a server to fiilfill the request. 
Thus, the user can initiate an HTTP request to hear textual information over the WWW to 
a server that includes TTS software. The server receives the HTTP request and executes 

25 TTS software on the server to convert the textual information to an audio format, such as 
a WAV file. The TTS server returns the audio output file to the client computer, which 
then plays the audio output file through the client's speaker for the user. 

One example of TTS software is the Festival Speech Synthesis System, which is a 
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TTS application that can execute on a server to provide text-to-speech conversion. The 
Festival Speech Synthesis System is available from the Centre for Speech Technology 
Research (CSTR), University of Edinburgh, Edinburgh, United Kingdom. 

5 SUMMARY OF THE INVENTION 

In a conventional approach, such as the approaches described above, a TTS server 
receives the request over the network for the TTS conversion and converts the entire body 
of text into one audio output file. Typically, this conversion process is computation 
intensive and takes sufficient time such that the user of a client computer or non- visual 
10 device (e.g. telephone) may notice a delay before hearing the beginning of the audio 
output file. For the conversion of large bodies of text, the delay can be noticeable, such 
as a delay of seconds or minutes. 

In one example of a conventional approach, suppose that a user of a non-visual 
device, such as a telephone, requests an audio output based on textual information using 
15 the telephone. The request is handled by a remote computer having TTS software, which 
is in communication with the non-visual device. As described above, a user may 
experience a substantial delay before beginning to hear the audio output representing the 
textual information due to the lengthy conversion process at the remote computer. 

Conversely, the invention is directed to an improved approach for providing TTS 
20 services over a network, such as for users of telephones who are accessing textual 

information over a web (such as the WWW), Part of the approach of the invention is to 
divide the body of textual information to be converted into speech into text portions that 
can be converted into speech in a relatively brief amount of time. In one embodiment of 
the invention, an application server receives the request for the conversion of the textual 
25 information and divides the body of textual information into the text portions. For 
example, suppose that a user of a telephone requests access to textual information by 
telephone, and passes this request to an intermediary device (e.g. a proxy browser) that 
serves as an intermediary between the telephone and the web. The proxy browser passes 
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the request (e.g. an HTTP request) to a web application executing on the application 
server. The web application determines the body of text to be converted, such as by 
locating the text in a database or over the web. The web application then divides the text 
into text portions. The web application also locates or determines a TTS server that is 
5 available and can handle the TTS conversion. The web application then sends back to the 
proxy browser a sequence of resource identifiers, such as Uniform Resource Locators 
(URL's). Each resource identifier includes a text portion and the identity of the TTS 
server. The sequence of the resource identifiers corresponds to the respective positions of 
the text portions in the body of text. The proxy browser can then make HTTP requests 
10 using the URL's to convert the text portions specified therein in a sequence that reflects 
g the respective positions of the text portions in the body of text. The TTS server receives 

i the requests, performs the conversions of the text portions, and provides back audio 

output files to the proxy browser. The proxy browser can then play back the audio output 
Q files over a connection to the telephone. Because the proxy browser makes the text 

1 5 portion web requests in sequence, then the user hears the body of text, for example over 
the telephone, in a substantially continuous manner as though the TTS server had 
Q converted the body of text as a whole into one audio file that the proxy browser plays for 

'M the user. 

^ In another example of the invention, a user who is sitting at a client computer that 

20 does not have TTS software available on it, uses a web browser on the client computer to 
access a web application performing on an application server, and desires to have textual 
information converted to speech. The textual information may be initially passed from 
the browser to the web application in its entirety. Alternatively, the textual information 
originates fi:om or is stored in a database accessed by the web application, or otherwise 
25 obtained by the web application (e.g. over the web). In any event, the web application 
divides the textual information into text portions and returns resource identifiers, such 
URL's, including respective text portions, to the client, as described above for the user of 
a telephone accessing a web application. The client's browser can then make HTTP 
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requests using the resource identifiers to a TTS server identified in the resource 
identifiers. The TTS server converts each text portion and returns an audio output file to 
the client representing each text portion. The client computer can then play each audio 
output file to the user over the speaker of the client computer. 
5 In one embodiment, the invention is directed to a system for providing text-to- 

speech conversion of a body of text. The system includes a first executable resource and 
a second executable resource. For example, the first executable resource can be a web 
application on one server computer that handles the initial request for the conversion of 
textual information to speech, and the second executable resource can be a TTS 
1 0 application on a different server computer than performs the conversion. The .first 

executable resource generates text portions from the body of text in response to receiving 
^ an initial v^eb request to convert the body of text to speech, and provides an output in 

, [1 response to generating the text portions. The output includes a sequence of resource 

identifiers suitable for use in the text-to-speech conversion of the text portions. Each of 
1 5 the resource identifiers includes a corresponding one of the text portions and an identity 
1.^ of a resource capable of performing the text-to-speech conversion. The second 

'Pk executable resource receives a text portion web request that requests the conversion of 

one or more text portions to an audio format. The text portion web request includes the 
Q text portion and one of the resource identifiers. The second executable resource provides 

20 one or more media files suitable for audio output in response to receiving the text portion 
web request. Thus, for example, a requester, such as a user of a client device, can hear 
the media files which represent the body of text that the first executable resource (e.g. 
web application) had previously divided into text portions. 

In another embodiment, the first executable resource generates the text portions in 
25 response to receiving an initial hypertext transport protocol (HTTP) request to convert the 
body of text to speech and provides a hypertext markup language (HTML) page including 
uniform resource locators (URL's) that includes text character strings suitable for 
conversion to the audio format. The identity of the resource includes an HTTP address of 
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the resource. The second executable resource receives one or more HTTP requests 
including one or more URL's in response to providing the output. For example^ a user 
can access the system from a local computer or client device, and then the system can 
perform the conversion from text to speech for the user over the web without requiring 
5 that any TTS software be installed on the local computer or client device. 

In one embodiment, the invention is directed to a method for providing text-to- 
speech conversion of a body of text. The method includes generating text portions from 
the body of text in response to receiving an initial web request to convert the body of text 
to speech, and providing an output in response to generating the text portions. The output 

10 includes a sequence of resource identifiers suitable for use in the text-to-speech 

conversion of the text portions. Each of the resource identifiers includes a corresponding 
one of the text portions and an identity of a resource capable of performing the text-to- 
speech conversion. The method further includes receiving a text portion web request that 
requests the conversion of one or more text portions to an audio format. The text portion 

15 web request includes the text portion and one of the resource identifiers in response to 
providing the output. The method additionally includes providing one or more media 
files suitable for audio output in response to receiving the text portion web request. Thus, 
for example, the method provides output media files to a client device to play to a user, so 
that the user hears an audio version of the body of text based on the text portions without 

20 the delay caused in conventional systems by waiting for the TTS conversion of one 
relatively large, undivided body of text to one media file. 

Another embodiment of the method of the invention includes generating text 
portions in response to receiving an initial HTTP request to convert the body of text to 
speech, and providing an HTML page comprising URL's that include text character 

25 strings suitable for conversion to the audio format. The identity of the resource includes 
an HTTP address of the resource. The method further includes receiving one or more 
HTTP requests that include one or more of the URL's in response to providing the output. 
The method provides for the conversion of the text portions representing the body of text 



over the web using HTTP protocols. Thus, a user who has access to the web can request 
the TTS conversion of text over the web. 

In one embodiment, the invention is directed to a server for providing text-to- 
audio resource information. The server includes a network interface and an executable 
resource. The executable resource generates text portions from a body of text, formats 
resource identifiers suitable for use in text-to-audio conversion of the text portions, and 
provides, through the network interface, an output comprising the resource identifiers in 
response to formatting the resource identifiers. Each of the resource identifiers includes a 
corresponding one of the text portions and an identity of a resource capable of performing 
the text-to-audio conversion. 

In another embodiment, the resource identifiers are URL's having text portions 
that include character strings suitable for conversion to an audio format. The identity of 
the resource is an HTTP address of the resource. In a further embodiment, the executable 
resource provides the resource identifiers in a prescribed sequence based on respective 
positions of the text portions in the body of text. For example, the executable resource 
(e,g, a web application) divides the body of text into smaller portions that are more 
readily converted to speech and identifies a TTS resource (e,g, a TTS application) that is 
capable of performing the TTS conversion of the text portions in the prescribed sequence. 
Thus, after the TTS conversion, a listener hears a speech version of the body of text as 
though converted in one step, and the conversion occurs more quickly than would occur 
in a conventional system that converts the body of text as a whole. 

In one embodiment, the invention is directed to a method in a server for providing 
text-to-audio resource information. The method includes generating text portions fi'om a 
body of text, formatting resource identifiers suitable for use in text-to-audio conversion of 
the text portions, and providing an output that includes the resource identifiers in 
response to formatting the resource identifiers. Each of the resource identifiers includes a 
corresponding one of the text portions and an identity of a resource capable of performing 
the text-to-audio conversion. In another embodiment, the method includes receiving an 
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initial request for a text-to-audio conversion of the body of text, and generating the text 
portions in response to receiving the initial request. Thus, the body of text is divided into 
text portions in response to an initial request that can be converted to audio more readily 
than the conversion of the body of text as a whole, as would be done in a conventional 
5 system. 

In an additional embodiment, the method includes generating each text portion in 
a manner suitable for inclusion in an HTTP request. Another embodiment of the 
invention includes providing the resource identifiers in the form of URL's having text 
portions that include character strings suitable for conversion to an audio format. The 

10 identity of the resource includes an HTTP address of the resource. In another 

embodiment, the method includes providing the resource identifiers in a prescribed 
sequence based on respective positions of the text portions in the body of text. For 
example, the executable resource (e.g. web application) divides the body of text into 
smaller portions that are more readily converted to speech and identifies a TTS resource 

1 5 (e.g. TTS application) that is capable of performing the TTS conversion of the text 

portions in the prescribed sequence. Thus, after the conversion, a listener hears a speech 
version of the body of text as though converted in one step, but more quickly than would 
occur for converting the body of text as a whole as would be done using a conventional 
system. 

20 In one embodiment, the invention is directed to a server for providing text-to- 

audio resource information. The server includes a network interface and a means for 
producing resource identifiers. The producing means generates text portions from a body 
of text, formats resource identifiers suitable for use in text-to-audio conversion of the text 
portions, and provides, through the network interface, an output comprising the resource 

25 identifiers in response to the step of formatting the resource identifiers. Each of the 

resource identifiers includes a corresponding one of the text portions and an identity of a 
resource capable of performing text-to-audio conversion. In another embodiment, the 
resource identifiers are URL's having text portions that include character strings suitable 
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for conversion to an audio format, and the identity of the resource is an HTTP address of 
the resource. 

In one embodiment, the invention is directed to a computer program product that 
includes a computer readable medium having instructions stored thereon for providing 
5 text-to-audio resource information. The instructions, when carried out by a computer, 
cause the computer to perform any or all of the operations disclosed herein of the 
invention. For example, the instructions cause the computer to generate text portions 
from a body of text, format resource identifiers suitable for use in text-to-audio 
conversion of the text portions, and provide an output comprising the resource identifiers 
1 0 in response to formatting the resource identifiers. Each of the resource identifiers 
i^g includes a corresponding one of the text portions and an identity of a resource capable of 

J performing the text-to-audio conversion. 

'f^ In one embodiment, the invention is directed to a text-to-audio server for 

Q providing text-to-audio conversion of a body of text. The text-to-audio server includes a 

15 network interface and an executable resource. The executable resource receives, through 
^JZ the network interface, a text portion web request that requests a conversion to an audio 

iQ format of one or more text portions generated from a body of text and generates a 

i: 3 response suitable for audio output in response to receiving the text portion web request. 

The text portion web request includes one or more text portions and the identity of a 
20 resource capable of text-to-audio conversion. In another embodiment, the text portion 
web request includes a URL that includes character strings suitable for conversion to an 
audio format, and the identity of the resource comprises an HTTP address of the resource. 
In a further embodiment, the response includes media files suitable for the audio output. 
Thus, a requester (e.g. client device or intermediary computer) of the TTS conversion of a 
25 body of text can make and fulfill requests for a text portion to be converted to a media file 
in a relatively quick manner for each text portion compared to the time needed to convert 
the whole body of text to speech in one step, and make additional requests for each text 
portion until the conversion of the body of text is complete. As the conversion occurs for 
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each media file, then a user (e.g. of a client device) hears the media file for each text 
portion as soon as each text portion has been converted. 

In one embodiment, the invention is directed to a method in a text-to-audio server 
for providing text-to-audio conversion of a body of text. The method includes receiving a 
text portion web request that requests a conversion to an audio format of one or more text 
portions generated from a body of text, and generating a response suitable for audio 
output in response to receiving the text portion web request. The text portion web request 
includes one or more text portions and the identity of a resource capable of text-to-audio 
conversion. In another embodiment, the method includes receiving a URL that includes 
character strings suitable for conversion to an audio format, and the identity of the 
resource includes an HTTP address of the resource. In an additional embodiment, the 
method includes generating media files suitable for the audio output. Thus, as noted 
above, a requester (e.g. a client device or intermediary computer) of the TTS conversion 
of a body of text can make and fulfill requests for a text portion to be converted to a 
media file in a relatively quick manner for each text portion compared to the time needed 
to convert the whole body of text to speech in one step, and make additional requests for 
each text portion until the conversion of the body of text is complete. As the conversion 
occurs for each media file, then a user (e.g. of a client device) hears the media file for 
each text portion as soon as each one has been converted. 

In another embodiment, the invention is directed to a text-to-audio server for 
providing text-to-audio conversion of a body of text. The text-to-audio server includes a 
network interface and means for converting text to audio. The converting means receives 
through the network interface a text portion web request that requests the conversion to 
an audio format of one or more text portions generated from a body of text, and generates 
a response suitable for audio output in response to receiving the text portion web request. 
The text portion web request includes the text portion and the identity of a resource 
capable of text-to-audio conversion. In a further embodiment, the text portion web 
request includes a URL that includes character strings suitable for conversion to the audio 
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format, and the identity of the resource includes an HTTP address of the resource. 

In a further embodiment, the invention is directed to a computer program product 
that includes a computer readable medium having instructions stored thereon for 
providing text-to-audio conversion of a body of text. The instructions, when carried out 
5 by a computer, cause the computer to perform any or all of the operations disclosed 
herein of the invention. For example, the instructions cause the computer to receive a 
text portion web request that requests the conversion to an audio format of one or more 
text portions generated from a body of text, and generates a response suitable for audio 
output in response to receiving the text portion web request. The text portion web request 
10 includes one or more text portions and the identity of a resource that is capable of text-to- 
'"i audio conversion. 

In one embodiment, the invention is directed to a method in a browser for 
:.g providing text4o-speech conversion of a body of text. The method includes requesting 

conversion of the body of text to speech, receiving a prescribed sequence of resource 
1 5 identifiers including respective text portions generated sequentially from the body of text, 
providing the resource identifiers in the prescribed sequence to the resource, and 
providing audio-based output according to the prescribed sequence, based on media files 
received from the resource in response to providing the resource identifiers. The media 
Q files represent the respective text portions. Each of the resource identifiers includes one 

20 of the respective text portions and an identity of a resource capable of performing the 
text-to-speech conversion. 

In another embodiment, the method includes receiving an HTML page that 
includes URL's that include text character strings suitable for conversion to an audio 
format. The method fiirther includes providing HTTP requests to a resource. The 
25 identity of the resource includes an HTTP address of the resource. For example, a proxy 
browser may be in communication with a client device, such as a cell phone or device 
without its own browser. In response to a request from the client device, the proxy 
browser can request the conversion of text to speech using HTTP protocols over the web 
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and coordinate the playback of audio files representing the text portions through the client 
device. 

In another embodiment, the invention is directed to a resource identifier suitable 
for use in requesting text-to-audio conversion over a netv^ork. The resource identifier 
5 includes a text portion generated from a body of text and an identity of a resource capable 
of converting the text portion to an audio format. In a further embodiment of the resource 
identifier, the text portion includes character strings suitable for conversion to the audio 
format. In an additional embodiment of the resource identifier, the identity of the 
resource is the HTTP address of the resource. Thus, the resource identifier provides a 

10 relatively compact way of requesting the conversion of a piece of text (i.e. a text portion) 
using a low overhead format for the request, such as an HTTP request. 

In one embodiment, the invention is directed to a computer data propagated signal 
embodied in a propagated medium, having a packet of data comprising a hypertext 
transport protocol (HTTP) request, which includes a text portion generated from a body 

15 of text and an identity of a resource capable of converting the text portion to an audio 
format. Thus, a computer receiving the propagated signal can convert the text portion 
received over the propagated medium to audio by making a request for the conversion to 
the identified resource. 

In some embodiments, the techniques of the invention are implemented primarily 

20 by computer software. The computer program logic embodiments, which are essentially 
software, when executed on one or more hardware processors in one or more hardware 
computing systems cause the processors to perform the techniques outlined above. In 
other words, these embodiments of the invention are generally manufactured as a 
computer program stored on a disk, memory, card, or other such media that can be loaded 

25 directly into a computer, or downloaded over a network into a computer, to make the 
device perform according to the operations of the invention. In one embodiment, the 
techniques of the invention are implemented in hardware circuitry, such as an integrated 
circuit (IC) or application specific integrated circuit (ASIC). 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects, features and advantages of the invention will be 
apparent from the following more particular description of preferred embodiments of the 
5 invention, as illustrated in the accompcinying drawings in which like reference characters 
refer to the same parts throughout the different views. The drawings are not necessarily 
to scale, emphasis instead being placed upon illustrating the principles of the invention. 

Fig. 1 is a block diagram illustrating a paradigm for providing text-to-speech 
(TTS) services via an IP network using a TTS server according to an embodiment of the 
1 0 present invention. 

Fig. 2 is a block diagram illustrating a client, a browser, an application server, and 
a TTS server according to one embodiment of the invention. 

Fig. 3 is a diagram illustrating a sample body of text and Uniform Resource 
Locators (URL's) including portions of text generated according to one embodiment of 
15 the invention. 

Fig. 4 is a flow chart of the process of providing resource identifiers (e.g., URL's) 
generated from a body of text according to one embodiment of the invention. 

Fig, 5 is a flow chart of the process of converting a text portion to an audio output 
file according to one embodiment of the invention. 
20 Fig. 6 is a flow chart of the process of requesting and playing audio output files 

representing text portions according to one embodiment of the invention. 

DETAILED DESCRIPTION 

The invention is directed to techniques for providing TTS services over a 
25 network, such as the Internet, to a user of a device, such as a client computer or non- 
visual device (e.g. telephone). The user accesses textual information over a network (e.g. 
web), which the user desires to convert to an audio format and hear over the speaker of 
the client computer or non- visual device. Part of the approach of the invention is to 
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divide a body of text to be converted into speech into text portions and to provide to the 
requester the text portions along with an identity of a TTS resource that can convert the 
text portions into speech. In one embodiment, an appHcation server receives the request 
for the conversion of the text, divides the body of text into text portions, and returns these 
5 text portions in a series of resource identifiers, each including a respective text portion. 

For example, in one embodiment of the invention, suppose a user of a telephone 
has requested access to textual information over the web by using the telephone, and 
passes this request to a proxy browser that serves as an intermediary between the 
telephone and the web. The proxy browser passes the request, (e.g. an HTTP request) to 

10 a web application executing on the application server. The web application accesses the 
web to locate the body of text to be converted and then divides the text into text portions. 
The web application also locates, such as by looking up in a table in a database, a TTS 
server that is available and can handle a TTS conversion of those text portions. The web 
application then returns to the proxy browser, or other intermediary, a sequence of 

15 resource identifiers (e.g. URL's), each resource identifier including a text portion and the 
identity of the TTS server. The sequence of the resource identifiers corresponds to the 
respective positions of the text portions in the body of text. The proxy browser can then 
make text portion web requests (e.g. HTTP requests) using the URL's to convert the text 
portions in a sequence that reflects the respective positions of the text portions in the 

20 body of text- The TTS server receives the requests in sequence from the proxy browser, 
performs the conversions of the text portions, and provides back audio output files to the 
proxy browser. For example, the proxy browser can then play back the audio output files 
over a connection to the telephone. Because the proxy browser makes the text portion 
web requests in sequence, then the user hears the body of text over the telephone in a 

25 substantially continuous manner as though the TTS server had converted the body of text 
as a whole into one audio file that the proxy browser plays for the user. 

In another example of one approach of the invention, a user is sitting at a client 
computer that does not have TTS software available on it, uses a web browser on the 
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client computer to access a web application perforaiing on an application server, and 
desires to have textual information converted to speech. The web application divides the 
textual information into text portions and returns resource identifiers, such URL's, to the 
client, as described above for the user of a telephone accessing a web application. The 
5 client's browser can then make HTTP requests using the resource identifiers to a TTS 
server identified in the resource identifiers. The TTS server converts each text portion 
and returns an audio output file to the client representing each text portion. The client 
computer can then play each audio output file to the user over the speaker of the client 
computer. 

1 0 Generally the approach of the invention is well suited for any client devices (e.g. 

computer, communication, or other type of device) that do not have TTS software 
performing natively on the client device. The approach of the invention also applies to 
client devices that do not have TTS software or a web browser resident on the client 
devices, in which case a proxy browser provides a connection between the client device 

15 and a web server, such as a TTS server, as will be discussed in connection with Fig. 1 
below. 

Fig. 1 is a diagram showing a sample approach for providing TTS services via an 
IP network 50 according to one embodiment of the invention. Fig. 1 illustrates client 
computers 42 (shown individually as 42a and 42b), a unified world IP (Internet Protocol) 

20 network 50, user client devices 18 (shown individually as clients 1 8a, 18b, 18c, 18d, 18e, 
and 18f), proxy browser 62, web server 64, application server 66, application 
environment 68, TTS server 302, and TTS application 304. The clients 18 include a 
cordless telephone 18a, a fax machine 18b having an attached telephone, an analog 
telephone 18c, a mobile phone 18d, a handheld computing device 18e, and a pager 18f (as 

25 described in more detail later). 

In general, a client (e.g. one of 42a, 42b, 18a-18f) makes a request for a text-to- 
audio conversion of textual information to the application server 66 (either directly for a 
client computer 42 or through the proxy browser 62 for clients 18a-18f). The application 
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server 66 divides the textual information or body of text into a sequence of text portions 
based on the respective positions of the text portions in the body of text. The application 
server 66 provides to the client computer 42 or to the proxy browser 62 a sequence of 
resource identifiers (e.g., Uniform Resource Locators or URL's) including the text 
5 portions and the identity (e.g., network hostname or address) of the TTS server 302. The 
client computer 42 or the proxy browser 62 can then use (e.g., can access or reference) the 
resource identifiers in a sequence of network requests (e.g., HTTP requests) 
corresponding to the sequence of the text portions in the text body to request from the 
TTS server 302 the conversion of each text portion to an audio-based output format (e.g., 

10 a WAV file). The TTS server 302 then converts the text portions in each request to 
audio-based output format and returns the audio-based output for each request to the 
client computer 42 or the proxy browser 62, The client computer 42 then plays or 
otherwise reproduces the audio-based output for the user through a speaker included or 
associated with the client computer 42. For client devices 18, the proxy browser 62 plays 

15 the audio output by providing electrical or other signals representing the audio output 
through a connection to the client 1 8 so that the user hears the audio output on a speaker 
that is part of or associated with the client 18. This process will be described in more 
detail later in connection with the flow charts illustrated in Figs. 4, 5, and 6. The 
individual components illustrated in Fig. 1 will be discussed in more detail in the 

20 following paragraphs. 

The web server 64 is preferably a server computer including a processor, a 
memory, and commimication hardware that enables communication over a network, such 
as the IP network 50. The web server 64 provides a communication connection between 
the proxy browser 62 and the application server 66. In one embodiment, the web server 

25 64 is a server providing communications over the World Wide Web. 

The application server 66 is a server computer including a processor, a memory, 
and communication hardware that enables communication over a network, such as the IP 
network 50. The application server 66 also includes an executable resource or web 
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application 68 that provides services in response to requests received over the netw^ork 

(e.g. HTTP requests received from the proxy brow^ser 62). 

The TTS server 302 is a server computer including a processor, a memory, and 

communication hardware that enables communication over a network, such as the IP 
5 network 50. The TTS server 302 includes an executable resource or TTS application 304 

that provides text-to-speech conversion services in response to requests received over the 

network (e.g. HTTP requests). Each executable resource 68 or 304 includes one or more 

programs, scripts, procedures, routines, objects, and/or other software entities, capable of 

executing on a computing device. 
10 The proxy browser 62 is a computing device including a processor, a memory, 

and communication hardware that enables communication over the IP network 50. The 
H proxy browser 62 provides browser services over the World Wide Web for clients that 

n have limited capabilities and which do not typically include their own web browsers. The 

proxy browser 62 is capable of making requests (e.g. HTTP requests) over the network to 
iii 1 5 the application server 66 and the TTS server 302. 

□ The fat client 42a is a computer system including a processor, a memory, an 

^% output device, such as a visual display, an input device for the customer to provide input, 

Q and communication hardware that enable communication over a network, such as the IP 

network 50. The fat client 42a includes a web browser 56 and a local application 44 
20 running on the fat client 42a and providing services to the fat client 42a. The fat client 
42a typically has the capacity to provide TTS software performing on the fat client 42a, 
but the user of the fat client 42a may not install TTS software on the fat client 42a and 
may choose to access TTS services over the IP network 50. 

The thin client 42b is a computer system including a web browser 56. The thin 
25 client 42b typically does not have the capacity to provide TTS software performing on the 
thin client 42b itself and accesses the TTS services from a server over the IP network 50. 

The user client devices 18a, 18b, and 18c, illustrated as a cordless telephone 18a, 
a fax machine 18b having an attached telephone, and an analog telephone 18c, are referred 
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to herein as "skinny clients/' defined as devices that are able to interface with a user to 
provide voice and/or data services (e.g., via a modem) but cannot perform any direct 
control of the associated access subnetwork. The wireless user client devices 18d, ISe, 
and 18f, illustrated as a mobile or cellular telephone 18d, a handheld computing device 
5 (e.g., a 3-Com Palm Computing or Windows CE-based handheld device) ISe, and a pager 
18f, are referred to as tiny clients. "Tiny clients" tend to have even less functionality than 
skinny clients in providing input and output interaction with a user. The handheld 
computing device 18e and pager 18f may require text-to-audio conversion of textual 
information if the devices 18e and 18f include a speaker that can provide the audio output 

1 0 representing textual information to the user of the device 1 8e and 1 8f. The client devices 
1 8a through 1 8f do not typically include a browser or TTS software resident or 
performing on them, and rely on the proxy browser 62 as an intermediary to handle text- 
to-audio conversion of textual information (through the application server 66 and TTS 
server 302 as described above), 

1 5 Fig. 2 is a block diagram illustrating an application server 66, a TTS server 302, 

browser 308 (e.g. proxy browser), and cUent 310. Each of the components illustrated in 
Fig. 2 is configured to operate according to embodiments of the invention. The 
application server 66 includes an executable resource or web application 68, as described 
above, and a network interface 306a that provides communication to other devices, such 

20 as the TTS server 302. The TTS server 302 includes an executable resource or TTS 
application 304, as described above, and a network interface 306b that provides 
communication to other devices, such as the application server 66. In one embodiment^ 
the browser 308 is a computing device that provides browsing services over a network 
(e.g. the World Wide Web). In another embodiment, the browser 308 is a software 

25 application or program providing browsing services over a network (such as a software 
browser installed and performing on a client computer or device 310). The proxy 
browser 62 shown in Fig, 1 is one example of a browser 308. The client 3 10 is a client 
device that does not have (or does not choose to use) TTS services available on the client 
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310. The client 310 can be one of the clients 42a, 42b, 18a-18f shown in Fig. 1 . The 
client 310 also includes other computing or communication devices that may require TTS 
services, and are able to access the application server 66 and TTS server 302. For 
example, the client 310 can be an IP telephony device in communication with a browser 
5 62 or client 42a or 42b. 

In one embodiment, a computer program product 380 including a computer 
readable medium (e.g. one or more CD ROM's, diskettes, tapes, etc.) provides software 
instructions for the browser 308, web application 68, and/or TTS application 304. The 
computer program product 380 can be installed by any suitable software installation 

10 procedure, as is well known in the art. In another embodiment, the software instructions 
can also be downloaded over a wireless connection, A computer program propagated 
signal product 382 embodied on a propagated signal on a propagation medium (e,g, a 
radio wave, an infrared wave, a laser wave, soxmd wave, or an electrical wave propagated 
over the Internet or other network) provides software instructions for the browser 308, 

15 web application 68, and/or TTS application 304. In alternate embodiments, the 

propagated signal is an analog carrier wave or a digital signal carried on the propagated 
medium. For example, the propagated signal can be a digitized signal propagated over 
the Internet or other network. In one embodiment, the propagated signal is a signal that is 
transmitted over the propagation medium over a period of time, such as the instructions 

20 for a software application sent in packets over a network over a period of seconds, 
minutes, or longer. In another embodiment, the computer readable medium of the 
computer program product 380 is a propagation medium that the computer can receive 
and read, such as by receiving the propagation medium and identifying a propagated 
signal embodied in the propagation medium, as described above for the computer 

25 program propagated signal product 382 

Fig. 3 illustrates a sample body of text 400 to be converted to speech, and resource 
identifiers 412 (e.g. URL's) including portions of text generated based on conversion of 
the body of text 400 to the text portions 402 according to one embodiment of the 
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invention. The text-to-speech conversion process will be described in connection with 
the flow charts illustrated in Figs. 4, 5, and 6. The sample body of text 400 includes, by 
way of example only, four lines or portions of text, referred to generally as text portions 
402. After the conversion process of the invention, the four text portions 402-1, 402-2, 
402-3, and 402-4 correspond to four URL's 412-1, 412-2, 412-3, and 412-4, which 
include reformatted versions of the respective text portions 402-1, 402-2, 402-3, and 
402-4. URL 412-1 includes text portion 402-1; URL 412-2 includes text portion 402-2; 
URL 412-3 includes text portion 402-3; and URL 412-4 includes text portion 402-4. 
URL 412-1 shows, by way of example only, one arrangement of the resource identifier 
412. The first part 420 of the URL 412-1 includes the HTTP address (e.g., a hostname in 
this example) of a text-to-speech server, referred to here as "TTSSERVER", The second 
part 422 of the URL 412-1 includes the name of a script, referred to here as "MAIN.CGI" 
used to perform the TTS conversion. In one embodiment, the script 422 corresponds to 
an application 68 executing on the application server 66. The third part of the URL 412-1 
includes a portion of text 424, formatted so that it can be included in the URL 412-1 and 
corresponding to the first portion of text 402-1 in the sample body of text 400. 

Fig. 4 is a flow chart of the process 500 of providing resource identifiers (e.g. 
URL's) generated from a body of text 400 according to one embodiment of the invention. 
In step 502, a browser 308 receives an initial request 312-1 (see Fig. 2) to convert a body 
of text 400 to speech. For example, the browser 308 initially receives the body of text 
400 from a client 3 1 0 or receives the body of text 400 as the result of service or 
information requested by the client 310 of the browser 308 in an initial request 312-1 
from the client 310 to the browser 308 (see Fig. 2). Then, the browser 308 provides a 
body of text 400 in a request (e.g. HTTP FORM POST request) 312-2 to the application 
server 66. 

In another example, a client 310 makes an initial request 312-1 to a browser 308 
for information or a service, such as a stock report describing an analysis of a stock that is 
to be returned to the client 3 10 as audio-based output to be played through a speaker 
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included or associated with the client device 3 1 0, The browser 308 passes on the request 
312-1 from the client 310 as a request 312-2 to the application server 66 (see Fig. 2). The 
web application 68 retrieves textual information as a result of the request 312-2, for 
example, from a local database of stock reports or by accessing a stock report service over 
5 the web. 

In step 504, the web application 68 divides the body of text 400 into portions of 
text 402 in response to receiving the initial web request 312-2. The web application 68 
sizes the text portions 402 so that they will be suitable for inclusion in a network request 
3 1 6 (see Fig. 2), For example, the network request 3 1 6 includes a URL, as shovm by 

10 sample URL's 412 in Fig. 3. If the request 316 is a HTTP GET request, then the size of 
the resource identifier 412 including a text portion should be no more than, for example, 
100 characters, in one embodiment. 

In step 506, the web application 68 provides an output 314 (see Fig, 2) that 
includes resource identifiers 412 (e.g. URL's) that can be used in converting the text 

15 portions 402 from text to speech. Each resource identifier 412 includes one of the text 
portions 402 and the identity of a resource (e.g. HTTP address) that can be used in 
converting the text portion 402 into an audio format (see Fig. 3). For example, the web 
application 68 provides an HTML page 314 including URL's 412 to the browser 308. 
The browser 308 can then make text portion web requests (e.g. HTTP requests) 3 16 to a 

20 TTS server 302 based on the URL's provided in the HTML page 314. The TTS server 
302 provides the text-to-speech conversion and then responds to the requests 316, as 
described below for Fig. 5. 

Fig. 5 is a flow chart of the process 600 of converting a text portion 402 to an 
audio output file 3 1 8 according to one embodiment of the invention. In step 602, the TTS 

25 server 302 receives the text portion web request 3 16, including a resource identifier, from 
the browser 308 (see Fig. 2). In one embodiment, the resource identifier 412 includes a 
reference to a script 422 and the text portion 424 to be converted to speech, as described 
for Fig. 3. For example, the browser 308 sends an HTTP request 316 including one of the 
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URL's 412 from an output HTML page 314 including a list of the URL's 412-1, 412-2, 
412-3, 412-4. The application server 66 provides the URL's 412 in the output HTML 
page 314 in a sequence such that the text portions 424 in the URL's 412-1, 412-2, 412-3, 
412-4 represent the respective positions of the text portions, 402-1, 402-2, 402-3, and 
5 402-4, in the body of text 400. The browser 308 then sends the URL's 412 in the same 
sequence (i,e. 412-1, 412-2, 412-3, 412-4) to the TTS server 302 as a sequence of text 
portion v^eb requests 3 16, so that the browser 308 can use the responses 318 (e.g. audio 
output files) to provide audio output 320 that represents the text portions 402-1, 402-2, 
402-3, 402-4 in their respective positions in the body of text 400. In effect, the user of the 
10 client device 310 hears all of the body of text 400 typically without noticeable delay. 

In step 604, the TTS server 302 parses the resource identifier 412 and identifies 
the script 422 (e.g. MAIN.CGI) and parses out the text portion 424 from the resource 
identifier 412. 

In step 606, the TTS server 302 passes the text portion 424 to the script 422 and 
1 5 the script 422 converts the text portion 424 from the URL format into a text format that 
the script 422 can use. For example, the TTS server 302 removes the plus signs (+) and 
other delimiters from the character string that makes up the text portion 424 to produce a 
reformatted text portion that the TTS server 302 provides as input to the script 422. 

In step 608, the script 422 executes a TTS converter to convert the reformatted 
20 text portion into an audio format (such as a WAV audio file format) and stores the audio 
version of the reformatted text portion in an audio output file 318 (e.g. WAV file). 

In step 610, the TTS server 302 provides a response 318 (e.g. HTML page) to the 
browser 308 listing the audio output file produced in step 608. The browser 308 then 
references the audio output file to provide an audio output 320 (e.g. electrical or other 
25 signals based on the audio output file provided in the response 3 18) to the client device 
310, which plays the audio output 320 on a speaker associated with the client device 310 
for the user of the client 310. 
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Fig. 6 is a flow chart of the process 700 of requesting and playing audio files by 
the browser 308 from the application server 66 and TTS server 302, for one embodiment 
of the invention. In step 702 the application server 66 sends the HTML page 3 14 to the 
browser 308. The HTML page 314 lists URLl, ULR2, and ULR3 (see e.g. URL 412 in 
5 Fig, 3). URLl , URL2, and URL3 each include an HTTP address (see e.g. 420 in Fig. 3) 
for the TTS server 302 and one text portion (see e.g. 424 in Fig. 3). 

In step 704, the browser 308 performs an HTTP GET request 316 using URLl 
(see e.g. 412-1 in Fig. 3) to the TTS server 302 to send the first portion of text (e.g. 
402-1) to the TTS server 302 and request its conversion to audio format. In step 706, the 
10 TTS server 302 receives URLl and generates an audio format file (e.g. WAVl) 

representing the first text portion (e.g. 402-1). In step 708, the TTS server 302 sends the 
! audio format file WAVl as a response 3 1 8 to the browser 308. In step 710, the browser 

308 plays WAVl for the client device 3 10 (i.e. sends electrical or other signal 
r;3 representing the WAV 1 file to the client device 3 1 0 which the client device 3 1 0 outputs 

■^^ 1 5 as audio output 320 through a speaker) so that the user of the client device 310 hears 
i f audio output 320 representing the first text portion (e.g. 402-1). 

n In step 712, the browser 308 performs an HTTP GET request 316 using URL2 

J~ (e.g. 412-2) to the TTS server 302 to send the second portion of text (e.g. 402-2) to the 

O TTS server 302 and request its conversion to audio format. In step 714, the TTS server 
20 302 receives URL2 and generates an audio format file (e.g. WAV2) representing the 

second text portion (e.g. 402-2). In step 716, the TTS server 302 sends the audio format 
file WAV2 as a response 318 to the browser 308. In step 718, the browser 308 plays 
WAV2 for the client device 3 1 0 so that the user of the client device 310 hears audio 
output 320 representing the second text portion (e.g. 402-2). 
25 In step 720, the browser 308 performs an HTTP GET request 3 1 6 using URL3 

(e.g. 412-3) to the TTS server 302 to send the third portion of text (e.g. 402-3) to the TTS 
server 302 and request its conversion to audio format. In step 722, the TTS server 302 
receives URL3 and generates an audio format file (e.g. WAV3) representing the third text 
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portion (e.g. 402-3). In step 724, the TTS server 302 sends the audio format file WAV3 
as a response 3 1 8 to the browser 308. In step 718, the browser 308 plays WAV3 for the 
client device 310 so that the user of the client device 310 hears audio output 320 
representing the third text portion (e.g. 402-3). 

If the application server 66 provided additional URL's in the output 3 14, then the 
process 700 described for Fig. 6 continues until all the text portions 402 represented in 
the URL's 412 have been played, and the user of the client device 310 hears the entire 
body of text 400. 

Alternately, each URL (e.g., URLl, URL2, URL3) is referenced by the browser 
308 in parallel. The TTS server 302 then handles the URL processing (i.e., TTS 
conversion) concurrently and returns the audio-based output to the browser 308 in a 
predetermined order. In another alternative, while the browser 308 plays one audio 
output file based on one URL (e.g., URLl), the browser 308 sends the next URL (e.g., 
URL2) to the TTS server 302. 

While this invention has been particularly shown and described with references to 
preferred embodiments thereof, it will be understood by those skilled in the art that 
various changes in form and details may be made therein without departing from the 
spirit and scope of the invention as defined by the appended claims. 

For example, the approach of the invention does not require the IP network 50 
illustrated in Fig, 1 to be based only on the IP (Internet Protocol) but can be based on 
other network protocols, or communication arrangements among computing and other 
types of devices, allowing for the sending and receiving of requests among the devices. 
Similarly, the approach of the invention does not require the requests to be web requests, 
IP requests, or HTTP requests, but can be other types of requests communicated over a 
network or connections among computing and other types of devices. 

In one embodiment, the web server 64 and application server 66 can be both 
implemented on one server computer system. In addition, the application server 66 and 
TTS server 302 can be implemented on one server computer system. In general, the 
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functions of the web server 64, application server 66, and TTS server 302 can be 
implemented on one or more computing systems in a distributed computing model, such 
as a distributed object approach. 

In addition, the client 310 and browser 308 arrangement of Fig. 2 is not required 
5 by the invention. For example, the client 310 can communicate directly with the 

application server 66 and the TTS server 68. As a further example, a user can provide 
input directly (e.g. sit at and type in input) to a browser 308 (e.g. computing device 
including its own web browser) and hear the audio output 320 through a speaker 
associated with the browser 308 without the involvement of any separate client device 
10 310. 
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CLAIMS 



What is claimed is: 

5 1. A system for providing text-to-speech conversion of a body of text, the system 
comprising: 

a first executable resource; and 

a second executable resource, wherein: 

the first executable resource generates text portions from the body 
1 0 of text in response to receiving an initial web request to convert the body 

of text to speech; 

the first executable resource provides an output in response to 
generating the text portions, the output comprising a sequence of resource 
identifiers suitable for use in the text-to-speech conversion of the text 
1 5 portions, each of the resource identifiers comprising a corresponding one 

of the text portions and an identity of a resource capable of performing the 
text-to-speech conversion; 

the second executable resource receives a text portion web request 
that requests the conversion of at least one text portion to an audio format, 
20 the text portion web request comprising the at least one text portion and 

one of the resource identifiers; and 

the second executable resource provides at least one media file 
suitable for audio output based on the text portion web request. 



25 
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The system of claim 1 , wherein: 

the first executable resource generates the text portions in response to 
receiving an initial hypertext transport protocol (HTTP) request to convert the 
body of text to speech; 

the first executable resource provides a hypertext markup language 
(HTML) page comprising uniform resource locators (URL's), wherein each URL 
comprises a text character string suitable for conversion to the audio format and 
an HTTP address of the resource; and 

the second executable resource receives at least one HTTP request 
comprising at least one of the URL's. 

A method for providing text-to-speech conversion of a body of text, the method 
comprising the steps of: 

generating text portions from the body of text in response to receiving an 
initial web request to convert the body of text to speech; 

providing an output in response to generating the text portions, the output 
comprising a sequence of resource identifiers suitable for use in the text-to-speech 
conversion of the text portions, each of the resource identifiers comprising a 
corresponding one of the text portions and an identity of a resource capable of 
performing the text-to-speech conversion; 

receiving a text portion web request that requests the conversion of at least 
one text portion to an audio format, the text portion web request comprising the at 
least text portion and one of the resource identifiers in response to the step of 
providing the output; and 

providing at least one media file suitable for audio output in response to 
the step of receiving the text portion web request. 
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The method of claim 3, wherein 

the step of generating text portions comprises generating text portions in 
response to receiving an initial hypertext transport protocol (HTTP) request to 
convert the body of text to speech; 

the step of providing the output comprises providing a hypertext markup 
language (HTML) page comprising uniform resource locators (URL's), each URL 
comprising a text character string suitable for conversion to the audio format and 
an HTTP address of the resource; and 

the step of receiving the text portion v^eb request comprises receiving at 
least one HTTP request comprising at least one of the URL's in response to the 
step of providing the output. 

A server for providing text-to-audio resource information, the server comprising: 
a network interface; and 

an executable resource, wherein the executable resource: 

generates text portions from a body of text; 

formats resource identifiers suitable for use in text-to-audio 
conversion of the text portions, each of the resource identifiers comprising 
a corresponding one of the text portions and an identity of a resource 
capable of performing text-to-audio conversion; and 

provides through the network interface an output comprising the 
resource identifiers. 
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The server of claim 5, wherein the resource identifiers are uniform resource 
locators (URL's) having text portions comprising character strings suitable for 
conversion to an audio format and the identity of the resource is a hypertext 
transport protocol (HTTP) address of the resource. 

The server of claim 5, wherein the executable resource provides the resource 
identifiers in a prescribed sequence based on respective positions of the text 
portions in the body of text. 

A method in a server for providing text-to-audio resource information, the method 
comprising the steps of: 

generating text portions from a body of text; 

formatting resource identifiers suitable for use in text-to-audio conversion 
of the text portions, each of the resource identifiers comprising a corresponding 
one of the text portions and an identity of a resource capable of performing the 
text-to-audio conversion; and 

providing an output comprising the resource identifiers in response to the 
step of formatting the resource identifiers. 

The method of claim 8, further comprising the step of 

receiving an initial request for a text-to-audio conversion of the body of 

text, 

wherein the step of generating the text portions comprises generating the 
text portions in response to the step of receiving the initial request. 

The method of claim 8, wherein the step of generating the text portions comprises 
generating each text portion in a manner suitable for inclusion in a hypertext 
transport protocol (HTTP) request. 
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The method of claim 8, wherein the step of providing the output comprises 
providing the resource identifiers in the form of uniform resource locators 
(URL's) having text portions comprising character strings suitable for conversion 
to an audio format and the identity of the resource comprising a hypertext 
transport protocol (HTTP) address of the resource. 

The method of claim 8, wherein the step of providing the output comprises 
providing the resource identifiers in a prescribed sequence based on respective 
positions of the text portions in the body of text. 

A server for providing text-to-audio resource information, the server comprising: 
a network interface; and 

a means for producing resource identifiers, wherein the producing means: 

generates text portions from a body of text; 

formats resource identifiers suitable for use in text-to-audio 
conversion of the text portions, each of the resource identifiers comprising 
a corresponding one of the text portions and an identity of a resource 
capable of performing text-to-audio conversion; and 

provides through the network interface an output comprising the 
resource identifiers in response to the step of formatting the resource 
identifiers. 

The server of claim 13, wherein the resource identifiers are uniform resource 
locators (URL's) having text portions comprising character strings suitable for 
conversion to an audio format and the identity of the resource is a hypertext 
transport protocol (HTTP) address of the resource. 
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A computer program product that includes a computer readable medium having 
instructions stored thereon for providing text-to-audio resource information, such 
that the instructions, when carried out by a computer, cause the computer to 
perform the steps of: 

generating text portions from a body of text; 

formatting resource identifiers suitable for use in text-to-audio conversion 
of the text portions, each of the resource identifiers comprising a corresponding 
one of the text portions and an identity of a resource capable of performing the 
text-to-audio conversion; and 

providing an output comprising the resource identifiers in response to the 
step of formatting the resource identifiers. 

The computer program product of claim 15, wherein the step of providing the 
output comprises providing the resource identifiers in the form of uniform 
resource locators (URL's) having text portions comprising character strings 
suitable for conversion to an audio format and the identity of the resource 
comprising a hypertext transport protocol (HTTP) address of the resource. 
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A text-to-audio server for providing text-to-audio conversion of a body of text, the 
text-to-audio server comprising: 
a network interface; and 

an executable resource, wherein the executable resource: 

receives through the network interface a text portion web request 
that requests the conversion to an audio format of at least one text portion 
generated from a body of text, the text portion web request comprising the 
at least one text portion and the identity of a resource capable of text-to- 
audio conversion; and 

generates a response suitable for audio output in response to 
receiving the text portion web request. 

The text-to-audio server of claim 17, wherein the text portion web request 
comprises a uniform resource locator (URL) comprising character strings suitable 
for conversion to the audio format and the identity of the resource comprises a 
hypertext transport protocol (HTTP) address of the resource. 

The text-to-audio server of claim 17, wherein the response comprises media files 
suitable for the audio output. 
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20. A method in a text-to-audio server for providing text-to-audio conversion of a 
body of text, comprising the steps of: 

receiving a text portion web request that requests the conversion to an 
audio format of at least one text portion generated from a body of text, the text 
5 portion v^eb request comprising the at least one text portion and the identity of a 

resource capable of text-to-audio conversion; and 

generating a response suitable for audio output in response to receiving the 
text portion web request. 



The method of claim 20, wherein the step of receiving the text portion web 
request comprises receiving a uniform resource locator (URL) comprising 
character strings suitable for conversion to the audio format and the identity of the 
resource comprises a hypertext transport protocol (HTTP) address of the resource. 

The method of claim 20, wherein the step of generating the response comprises 
generating media files suitable for the audio output. 

A text-to-audio server for providing text-to-audio conversion of a body of text, the 
text-to-audio server comprising: 
20 a network interface; and 

means for converting text to audio, wherein the converting means: 

receives through the network interface a text portion web request 
that requests the conversion to an audio format of at least one text portion 
generated from a body of text, the text portion web request comprising the 
25 at least one text portion and the identity of a resource capable of text-to- 

audio conversion; and 

generates a response suitable for audio output in response to 
receiving the text portion web request. 
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The text-to-audio server of claim 23, wherein the text portion web request 
comprises a uniform resource locator (URX^) comprising character strings suitable 
for conversion to the audio format and the identity of the resource comprises a 
hypertext transport protocol (HTTP) address of the resource. 

A computer program product that includes a computer readable medium having 
instructions stored thereon for providing text-to-audio conversion of a body of 
text, such that the instructions, when carried out by a computer, cause the 
computer to perform the steps of: 

receiving a text portion web request that requests the conversion to an 
audio format of at least one text portion generated from a body of text, the text 
portion web request comprising the at least one text portion and the identity of a 
resource capable of text-to-audio conversion; and 

generating a response suitable for audio output in response to receiving the 
text portion web request. 

The computer program product of claim 25, wherein the step of receiving the text 
portion web request comprises receiving a uniform resource locator (URL) 
comprising character strings suitable for conversion to the audio format and the 
identity of the resource comprises a hypertext transport protocol (HTTP) address 
of the resource. 
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A method in a browser for providing text-to-speech conversion of a body of text, 
the method comprising the steps of: 

requesting conversion of the body of text to speech; 

receiving a prescribed sequence of resource identifiers comprising 
respective text portions generated sequentially from the body of text, each of the 
resource identifiers comprising one of the respective text portions and an identity 
of a resource capable of performing the text-to-speech conversion; 

providing the resource identifiers in the prescribed sequence to the 
resource; and 

providing audio-based output according to the prescribed sequence, based 
on media files received from the resource in response to providing the resource 
identifiers, the media files representing the respective text portions. 

The method of claim 27, wherein 

the step of receiving the prescribed sequence of resource identifiers 
comprises receiving a hypertext markup language (HTML) page comprising 
uniform resource locators (URL's) comprising text character strings suitable for 
conversion to an audio format and a hypertext transport protocol (HTTP) address 
of the resource; and 

the step of providing the resource identifiers in the prescribed sequence to 
the resource comprises providing hypertext transport protocol (HTTP) requests to 
the resource. 
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29, A resource identifier suitable for use in requesting text-to-audio conversion over a 
network, comprising: 

a text portion generated from a body of text; and 

an identity of a resource capable of converting the text portion to an audio 

5 format. 

30. The resource identifier of claim 29, wherein the text portion comprises character 
strings suitable for conversion to the audio format. 

The resource identifier of claim 29, wherein the identity of the resource is a 
hypertext transport protocol (HTTP) address of the resource. 

A computer data propagated signal embodied in a propagated medium, having a 
packet of data comprising a hypertext transport protocol (HTTP) request, the 
HTTP request comprising: 

a text portion generated from a body of text; and 

an identity of a resource capable of converting the text portion to an audio 

format. 
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APPARATUS AND METHODS FOR CONVERTING TEXTUAL 
INFORMATION TO AUDIO-BASED OUTPUT 

ABSTRACT OF THE DISCLOSURE 

5 

The invention is directed to techniques for providing text-to-speech conversion of 
textual information at the request of a user of a cHent device, such as a computer or non- 
visual communication device (e.g. telephone). In one embodiment, a proxy browser 
receives the request for the audio output of a body of text from the client device and 

10 passes it to a web application in the form of a hypertext transport protocol (HTTP) 
request. The web application divides the body of text into text portions that can be 
readily converted from text to speech by text-to-speech (TTS) software. The web 
application determines the identity of a TTS server providing TTS software that is 
capable of converting the text portions to an audio output format. The web application 

1 5 then provides a sequential list of resource identifiers to the proxy browser, in which each 
resource identifier includes one of the text portions and the identity of the TTS server. 
The proxy browser then make web requests based on the resource identifiers to the TTS 
server. Each web request includes one of the text portions. The TTS server then converts 
the text portion included in each web request to an audio file, and sends the audio file to 

20 the proxy browser. The proxy browser then plays the audio file through a connection to 
the client device, and the user hears the audio file through the client device's speaker. If 
the proxy browser make all the text portion web requests in sequence corresponding to 
the text portions for the entire body of text, then the user hears the entire body of text in a 
substantially continuous manner. 



25 



o 

CO 








§ < 




LL 


Lli 


a: 




LU 


V9 


INI 


o 




00 







1- 



CO 





2 




O 


a: 




LU 




> 


o 


CNJ 


01 


-J 


o 


LU 


0. 


CO 


CO 


CL 


CO 


< 


1- 


CO 


h- 


H 




H 








o 




CO 







9 o 
§ < 


H 


LL 


UJ 


cc: 




LU 


6B 


INT 


o 




CO 





^ LU 

I- 3 

^ a CD 

O UJ ^ 

Q- a: ^ 

I- CQ 

X LU 

UJ > 



00 



UJ 
CO 

o 

0- 

CO 
UJ 



(D 



ui o ui 
001^ cir CO 

CQ LU CQ 






1- 


o 


-z. 




UJ 


CO 


_i 




O 



I- 

CL 
f- 

o 
g 

Q 

< 



LU 
DC 
< 

O + Q_ 




00 

O 

LL 



o 




1- 

o 

Q_ 



LU 
CO 

o 

CXI 
CD 

Ol 
X X 
LU H 

»- 3 
UJ 
X 

H- _ 
CO 

LU ai 

' UJ 



O 
I- 

CO 



o 



> 

LU 
O 
LU 



CC LU 

^§ 

CO CO 
LU 

X LiJ 
LU ^- 

m o 

CO ^ 



g 
o 

CL 

h- 

X 
UJ 

h- 

Q 

z: 
< 

Q- 

O 
CO 

LU 
X 
H 

CO 
LU 

Q 
Z) 
-J 

o 



o 



X £ 

LU ~ 
H 1- 

SI a: 



LU 



UJ a: 

o LU 

CO ^ 

UJ LU 

0^ CD 



LU 




X 




H 




CO 




UJ 




LL 


HE 


h- 


H 


EN 




Q 


o 




DC 


Q 


LL 


AN 


NO 


IFR 


RTi 




O 


h- 


Q_ 




H 
X 


9 


UJ 


LU 


h- 


O 


LU 


I 1 Di 

UK' 


HI 


O 


H 


CO 


ZD 


LU 


o 


a: 


CO 


LU 


LU 


X 


CO 


1- 


DC 




PA 


CO 


Q 


a: 


z 


< 


< 


CL 




CC 


O LU 


LU 


O E 


> 
DC 
UJ 


MAIN. 
IDENTI 


o o 


H- 


^ LU 


H 


Lii o 


LU 


X 




H 






CO 




O LU 


cd! 


CO DC 



CL 



X 
LU 

< 

o 



a: 
o 

CO cc 



o 
u_ 
-J 
a: 

ZD 
UJ 
X 



LU O 

UJ q:: 

X o 

h- CL 

CO H 

LU X 

CO UJ 
CO 



UJ 

CO 

< 

o 



< 
a. 



I- CL 



UJ cc 

X o 

h- CO 

^ CO LU 

LU 
> 



m 

CO 
CO 



X 

I- 



UJ 
X 



o 
o 



< 

X 

< 



Q_ _ 

01 CC 

0|0 O 

CdICO Li_ 





LU 






X 






h- 




XT 


OF 




LU 


z 




H 


o 




THE 


ERSI 






> 




VER 


DIO 




z 


ZD 




O 


< 




o 


UJ 




o 


X 




1- 


H 




cc 


CO 




LU 


UJ 




1- 






QC 


o 




UJ 


H 




> 


CO 




z 


Q 




o 


z 




o 


< 




CO 






1- 


< 


■|LE. 


A T 


RM. 


CO 


O 


U- 


UJ 


LL 


o 


ECUT 


UDIO 


AUDI 


X 


< 


h- 


IPT E 


AN 


O. 
H 


O 


Z) 


cc 


H 


O 


HESC 


Z 

z 


AN 


O 


z 


h- 


1- 


h- 


coi 




X 




o 


UJ 


cdI 


Q_ 






Q 
O 



LU 



a: 
111 
> 

< LJJ LJJ 

CO O 

3 Q- 



UJ 

o 
> 

LU 
Q 
H- 

LU 
_l 

o 

O 
u. 

< 

Dl 
o 



I 



LU 
LU 

2: 

LU 
CD 

cm" 
_] 
IT 

LU 
> 
LU 
O 
LU 
DC 



—1 
O 



CO 

f- 
UJ 
(D 

CL 



O 

LL 

q: 

UJ 

□_ 



LU 
CO 

o 
a: 

O 
H 

I 



LU 
CO 

CD 



LU 

o 
> 

LU 
Q 



LU 

o 
o 

5 



>- 

< 



001 



i 



UJ 
!- 
< 

UJ 

LU 
CD 

co" 
_J 

q: 

UJ 
> 
UJ 

O 
UJ 

a: 

CNl 
CM 



CO 
_1 
01 

CD 

CO 
Z) 

\- 

LU 
O 
CL 



a: 
o 

LL 

q: 

UJ 
CL 
O 
CM 



UJ 
CO 

o 

DC 
CD 

O 
h- 

co 

Q 

LU 
CO 

^1 
CM 



LU 

o 
a 



LU 
_J 

o 

DC 

o 

co 

< 



CD 
CM 




o 
o 



DOCKET NO. CISOO-2413 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

Declaration for Patent Application 
As a named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated next to my name; 

I believe I am the original, first and sole inventor (if only one name is listed) or an original, first and joint 
inventor (if plural names are listed in the signatory page(s) commencing at page 3 hereof) of the subject matter which 
is claimed and for which a patent is sought on the invention entitled 

APPARATUS AND METHODS FOR CONVERTING TEXTUAL 
INFORMATION TO AUDIO-BASED OUTPUT 

the specification of which (check one) 
[ X ] is attached hereto, 
was filed on 



[ ] 



. as United States Application 



Number or PCT International Application No. 

and was amended on (if applicable). 

I hereby state that I have reviewed and understand the contents of the above-identified specification, 
including the claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose information which is known by me to be material to patentability as 
defined in 37 C.F.R. §1,56. 

I hereby claim foreign priority benefits under 35 U.S.C. 1 19(a)-(d) or 365(b) of any foreign application(s) 
for patent or inventor's certificate or 365(a) of any PCT international application which designated at least one 
country other than the United States of America, listed below and have also identified below, by checking the box, 
any foreign application for patent or inventor's certificate, or of any PCT international application having a filing 
date before that of the application on which priority is claimed: 



Prior Foreign Application(s) 



(Number) 


(Country) 


(Day/Monthrfear filed) 


(Number) 


(Country) 


(Day/MonthA^ear filed) 



Priority 

Not 
Claimed 

[ ] 



[ ] 



[ ] 



Certified 
Copy Filed? 
YES NO 



[ ] 
[ ] 
[ ] 



[ ] 
[ ] 
[ ] 



(Number) (Country) (Day/MonthA'ear filed) 

I hereby claim the benefit under 35 U.S.C. §1 19(e) of any United States provisional application(s) listed below. 
(Application Number) (Filing Date) 



(Application Number) 



(Filing Date) 



-2- 



DOCKET NO. CISOO-2413 



I hereby claim the benefit under 35 U.S.C. 120 of any United States application(s), or 365(c) of any PCT 
international application designating the United States of America, listed below and, insofar as the subject matter of 
each of the claims of this application is not disclosed in the prior United States or PCT International application in 
the manner provided by the first paragraph of 35 U.S.C. 1 12, 1 acknowledge the duty to disclose information known 
by me to be material to patentability as defined in 37 C.F.R. 1.56 which became available between the filing date of 
the prior application and the national or PCT international filing date of this application- 



(Application Serial No.) 


(Filing date) 


(Status: patented, pending, abandoned) 


(Application Serial No.) 


(Filing date) 


(Status: patented, pending, abandoned) 


(Application Serial No.) 


(Filing date) 


(Status: patented, pending, abandoned) 


(Application Serial No.) 


(Filing date) 


(Status: patented, pending, abandoned) 



As a named inventor, I hereby appoint the following attomey(s) and/or agent(s) to prosecute this application 
and transact all busmess m the Patent and Trademark Office connected therewith. 

I also hereby grant additional Powers of Attorney to the following attomey(s) and/or agent(s) to file and 
prosecute an mtemational application under the Patent Cooperation Treaty based upon the above-identified 
application, including a power to meet all designated office requirements for designated states' 



Bany W. Chapin, Esq. 
David E. Huang, Esq. 
J. Scott Southworth, Esq. 



Reg. No. 39,934 
Reg. No. 39,229 
Reg. No. 39,382 



all of Chapin & Huang, L.L.C., Westborough Office Park, 1700 West Park Drive, Westborough, MA 01581 
and 



to prosecute this application and to transact all business in the Patent and Trademark Office connected therewith. 
Please send correspondence to: Barry W. Chapin. Esq. 



Chapin & Huang, L.L.C. Westborough Offi ce Park. 1700 West Park Drive. Westborough, MA 01581 

Direct telephone calls to: Barry W. Chapin. Esq , Telephone No.: 508-366-9600 

Direct facsimiles to: Barry W. Chapin. Esq . Facsimile No.: 508-616-9805 



I hereby declare that all statements made herein of my own knowledge are true and that all statements made 
on information and belief are believed to be true; and further that these statements were made with the knowledge 

1^ , Statements and the like so made are punishable by fme or imprisonment, or both, under Section 
1001 ot Title 18 of the United States Code and that such willful false statements may jeopardize the validity of the 
application or any patent issued thereon. 



Full name of sole inventor or 
first joint inventor L^wis D.J)odri 
Inventor's Signature ^^^^^ 
Residence 12401 Northlake Place 




Citizenship 



Post Office Address 



Date VygA^ 



Richmond, Virginia 23233 



United States of America 



Same as above 



-3- 



DOCKET NO. CISOO-2413 



Full name of additional joint 
inventor Ryan A. Danner 



Inventor's Signature m^A^-eL Date ^/-g^Ao 



Residence 1 1401 Brockton Place 



Glen Allen Virginia 23Q6Q 



Citizenship United States of America 



Post Office Address Same as above 



Full name of additional joint 



inventor 

Inventor's Signature, 
Residence 




Richmond, Virginia 23233 

Citizenship United States of America 

Post Office Address Same as above 



